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\ Abstract 
Oh 1 

• Two natural strategy elimination procedures have been studied for strategic games. The 

\ first one involves the notion of (strict, weak, etc) dominance and the second the notion of 

■ rationalizability. In the case of dominance the criterion of order independence allowed us to 

£S| [ clarify which notions and under what circumstances are robust. In the case of rationalizability 

this criterion has not been considered. 

In this paper we investigate the problem of order independence for rationalizability by fo- 
cusing on three naturally entailed reduction relations on games. These reduction relations are 
distinguished by the adopted reference point for the notion of a better response. Additionally, 
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CZ3 . they are parametrized by the adopted system of beliefs. 

We show that for one reduction relation the outcome of its (possibly transfinite) iterations 
does not depend on the order of elimination of the strategics. This result does not hold for the 
other two reduction relations. However, under a natural assumption the iterations of all three 
. reduction relations yield the same outcome. 

| The obtained order independence results apply to the frameworks considered in Bernheim 

f^i . [1984] and Pcarce [1984]. For finite games the iterations of all three reduction relations coincide 

0^ ' and the order independence holds for three natural systems of beliefs considered in the literature. 

O ' 

in 

1 Introduction 

Rationalizability was introduced in Bernheim [1984] and Pearce [1984] to formalize the intuition 
that players in non-cooperatives games act by having common knowledge of each others' rational 
^ ■ behaviour. Rationalizable strategies in a strategic game are defined as a limit of an iterative process 

in which one repeatedly removes the strategies that are never best responses (NBR) to the beliefs 
held about the other players. In contrast to the iterated elimination of strictly and of weakly 
dominated strategies at each stage all 'undesirable' strategies are removed. 

Much attention was devoted in the literature to the issue of order independence for the iterated 
elimination of strictly and of weakly dominated strategies. It is well-known that strict dominance is 
order independent for finite games (see Gilboa, Kalai and Zemel [1990] and Stegeman [1990]), while 
weak dominance is order dependent. This has been often used as an argument in support of the 
first procedure and against the second one, see, e.g., Osborne and Rubinstein [1994]. On the other 
hand, Dufwenberg and Stegeman [2002] indicated that order independence for strict dominance 
fails for arbitrary games though does hold for a large class of infinite games. 

The criterion of order independence did not seem to be applied to assess the merits of the 
iterated elimination of NBR. In this paper we study this problem by analyzing what happens when 
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at each stage of the iterative process only some strategies that are NBR are eliminated. This 
brings us to a study of three naturally entailed reduction relations. They are distinguished by the 
adopted reference point for the notion of a better response, which can be the initial game, the game 
currently being reduced or the reduced game. Additionally, they are parametrized by the adopted 
system of beliefs. In general these relations differ and transfinite iterations are possible. 

We show for one reduction relation that for all 'well-behaving' systems of beliefs the outcome 
of the iterated elimination of strategies does not depend on the order of elimination. The result 
does not hold for the other two reduction relations, even for two-person games and beliefs being 
the strategies of the opponent. 

Further, using a game modeling a version of Bertrand competition between two firms we show 
that the variants of these reduction relations in which all strategies that are NBR are eliminated 
differ, as well. The same example also shows that the relation considered in Bernheim [1984], 
according to which at each stage all strategies that are NBR are eliminated, yields a weaker 
reduction than the one according to which at each stage only some strategies that are NBR are 
eliminated. In other words, natural games exist in which it is beneficial to eliminate at certain 
stages only some strategies that are NBR. 

The situation changes if we assume that for each belief /ij in a restriction G of the original game 
a best response to /ij in G exists. We show that then the iterations of all three reduction relations 
yield the same outcome. This implies order independence for all three reduction relations for the 
class of games for which Dufwenberg and Stegeman [2002] established order independence of the 
iterated elimination of strictly dominated strategies. 

A complicating factor in these considerations is that iterations of each of the reduction relation 
can reduce the initial game to an empty game. We discuss natural examples of games for which 
the unique outcome of the iterated elimination process is a non-empty game. In particular, order 
independence and non-emptiness of the final outcome holds for a relaxation of two elimination 
procedures studied in the literature: 

• the one considered in Bernheim [1984], concerning a compact game with continuous payoff 
functions, in which at each stage we now eliminate only some strategies that are NBR (to 
the joint strategies of the opponents), and 

• the one considered in Pearce [1984], concerning mixed extension of a finite game, in which at 
each stage we now eliminate only some mixed strategies that are NBR (to the elements of 
the products of convex hulls of the opponents' strategies). 

The definition of rationalizable strategies is parameterized by a system of belief. In the case of 
finite games three natural alternatives were considered: 

• joint pure strategies of the opponents, see, e.g., Bernheim [1984], 

• joint mixed strategies of the opponents, see, e.g., Bernheim [1984] and Pearce [1984], 

• probability distributions over the joint pure strategies of the opponents, see, e.g., Bernheim 
[1984] and Osborne and Rubinstein [1994]. 

A direct consequence of our results is that for finite games order independence holds for all three 
reduction relations and all three alternatives of the systems of belief. 

In summary, all three versions of the iterated elimination of NBR are order independent for the 
same classes of games for which iterated elimination of strictly dominated strategies was established. 
Additionally, for one version order independence holds for all 'well-behaving' systems of beliefs. 



2 Preliminaries 

Given n players we represent a strategic game (in short, a game) by a sequence 

(Si, . . -,S n ,pi, . . .,p n ), 

where for each i £ [l..n] 

• Si is the non-empty set of strategies available to player i, 

• pi is the payoff function for the player i, so pi : Si x . . . x S n — > 1Z, where 7Z is the set of real 
numbers. 

Given a sequence of non-empty sets of strategies S%, . . .,S n and s € Si x . . . x S n we denote the 
iih element of s by Si and use the following standard notation: 

• S—i . — (si) • • Sj_l, Sj_|_l, . . ., Sn), 

• (s-, s-i) := (si, . . ., Sj_i, s-, Si+i, . . -,s n ), where we assume that s- G Si, 

• S-i := Si x ... x Si-x x S i+1 x ... x S n . 

We denote the strategies of player i by Sj, possibly with some superscripts. 

By a restriction of a game i7 := (Ti, . . .,T n ,px, . . -,p n ) we mean a game G := (Si, . . ., S n ,px, 
...,p n ) such that each Si is a (possibly empty) subset of Ti and each pi is identified with its 
restriction to the smaller domain. We write then G C H. 

If some Sj is empty, we call G a degenerate restriction of H. In this case the references to 
Pj{s) (for any j £ [1-^]) are incorrect and we shall need to be careful about this. If all Si are empty, 
we call G an empty game and denote it by n . If no Si is empty, we call G a non- degenerate 
restriction of ff. 

Similarly, we introduce the notions of a union and intersection of a transfinite sequence 
(G a ) Q<7 of restrictions of H (a and 7 are ordinals) denoted respectively by Ua<7 G a and n«< 7 

3 Belief structures 

We assume that each player i in the game H = (Ti, . . ., T n ,px, ■ ■ .,p n ) has some further unspecified 
non-empty set of beliefs Bi about his opponents. We call then B := (Bx, ■ ■ - ,B n ), a belief system 
in the game H. We further assume that each payoff function pi can be modified to an expected 
payoff function pi : S, x Bi — > 1Z. 

Then we say that a strategy Sj of player i is a 6esi response to a belief ^ £ Bi in H if for all 
strategies s ■ € Tj 

Pi{si,m) > Pi{s'i,^i). 

In what follows we also assume that each set of beliefs Bi of player i in H can be narrowed to 
any restriction G of H. We denote the outcome of this narrowing of Bj to G by Z3j n G. The 
beliefs in £?j n G can be also considered as beliefs in the game G. We call then the pair (B,C\), 
where B := (Bx, . . .,B n ), a belief structure in the game H. 

Finally, given a belief structure (£>, n) in a game H we say that a restriction G of -ff is B- closed 
if each strategy Sj of player i in G is a best response in H (note this reference to H and not G) to 
a belief in h G. 

Fix now a game H := (Ti, . . .,T n ,px, ■ ■ .,p n ) and a belief structure n) in H. The following 
natural property of n will be relevant. 



A If G x C G 2 C il, then for all i € [l..n], nGiC6 8 n G 2 . 



The following belief structure will be often used. Assume that for each player his set of beliefs 
Bi in the game H := (T\, . . .,T n ,pi, . . .,p n ) consists of the joint strategies of the opponents, i.e., 
Bi = T-i. For a restriction G := (Si, . . ., S n ,p±, . . .,p n ) of H we define T_j (1 G := S_j. Note that 
property A is then satisfied. We call (B, fl) the pure 1 belief structure in H. 

4 Reductions of games 

Assume now a game H and a belief structure n) in H. We introduce a notion of reduction ~> 
between a restriction G := (Si, . . ., S n ,pi, . . - ,p n ) of -ff and a restriction G' := (S[, . . ., S' n ,p\, . . - ,p n ) 
of G defined by: 

• G ~> G' when G ^ G and for all i G [l..n] 

no Si £ S{ \ Sj' is a best response in if to some fii G 2% h G. 

Of course, the ~» relation depends on the underlying belief structure (B, fl) in ii but we do not 
indicate this dependence as no confusion will arise. Note that in the definition of ^> we do not 
require that all strategies that are NBR are removed. So in general G ~> G can hold for several 
restrictions G . Also, what is important, we refer to the best responses in H and not in G or G'. 
The reduction relations that take these two alternative points of reference will be studied in the 
next section. 

Let us define now appropriate iterations of the ~» relation. We shall use this concept for various 
reduction relations so define it for an arbitrary relation i — > between a restriction G of H and a 
restriction G of G. 

Definition 4.1 Consider a transfinite sequence of restrictions (G Q! ) Cf < 7 of H such that 

• H = G , 

• for all a < 7, G a 1 — ► G Q+ i, 

• for all limit ordinals (3 < 7, G^ = C\ a <f3 ^a> 

• for no G', G 7 1 — > G' holds. 

We say then that (G Q ) Q < 7 is a maximal sequence of the 1 — > reductions and call G 7 its outcome. 
Also, we write H 1 — > Q G a for each a < 7. □ 

We now establish the following general order independence result. 

Theorem 4.2 (Order Independence) Consider a game H and a belief structure (B, fl) in ff. 

Assume property A. Then any maximal sequence of the ~> reductions yields the same outcome 
which is the largest restriction of H that is B-closed. 

Proof. First we establish the following claim. 

to indicate that it involves only pure strategies of the opponents 



Claim 1 There exists a largest restriction of if that is B-closed. 

Proof. First note that each empty game is £>-closed. Consider now a transfinite sequence of 
restrictions (G a ) a<1 of ff such that each G a is £>-closed. We claim that then |J a<7 G a is £>-closed, 
as well. 

To see this choose a strategy S{ of player i in U a < 7 G a ■ Then s, is a strategy of player i in G ao 
for some ao < 7. The restriction G ao is 0-closed, so for some /ii G Bi n G ao the strategy Si is a 
best response to ^ in ff . By property A in G Bi h U Q < 7 ^a- 1=1 

Consider now a maximal sequence (G a ) a < 7 of the ~> reductions. Take a restriction if' of if 
such that for some a < 7 

• if' is £>-closed, 

• if' c G«. 

Consider a strategy Sj of player i in if'. Then s, is also a strategy of player i in G a . if' is £>-closed, 
so Si is a best response in ff to a belief ^ £ Bi n H' . By property A /ij G 23j h G a . So by the 
definition of the ~> reduction the strategy Sj is not deleted in the transition G a i.e., Sj is 

a strategy of player i in Hence H' C G a +i. 

We conclude by transfinite induction that if' C G 7 . In particular we conclude that Gjg C G 7 , 
where G# is the largest restriction of if that is ^-closed and the existence of which is guaranteed 
by Claim 1. 

But also G 7 C G& since G 7 is S-closed and Gq is the largest restriction of ff that is £>-closed. 

□ 

Since at each stage of the above elimination process some strategy is removed, this iterated 
elimination process eventually stops, i.e., the considered maximal sequences always exist. The 
result can be interpreted as a statement that each, possibly transfinite, iterated elimination of 
NBR yields the same outcome. 

The ~> reduction allows us to remove only some strategies that are NBR in the initial game 
if. If we remove all strategies that are NBR, we get the reduction relation that corresponds to 
the ones considered in the literature for specific belief structures. It is defined as follows. Consider 
a restriction G := (Si, . . ., S n ,pi, . . .,p n ) of ff and a restriction G' := (S[, . . ., S' n ,pi, . . -,p n ) of G. 
We define then the 'fast' reduction * ~» by: 

• G G' when G/G' and for all i G [l..n] 

S'i = {si G Si I 3/Xi G Bi h GVs'i G TiPi(s'i,fj,i) <Pi(si,m)}. 

Since the * ^> reduction removes all strategies that are never best responses, G * ^ G' and 
G ^ G" implies G' C G". 

We now show that the iterated application of the f~~> reduction yields a stronger reduction than 
~> and that * ~> is indeed 'fast' in the sense that it generates reductions of the original game ff 
faster than the ~> reduction. While this is of course as expected, we shall see in the next section 
that these properties do not hold for a simple variant of the ^ reduction studied in the literature. 

Theorem 4.3 Consider a game H and a belief structure (B,Pi) in H. Assume property A. 



(i) Suppose G ^ G' and G ^ G" . Then G' C G" . 



(ii) Suppose H G and H ~~^ 7 G. Then (3 < 7. 

Proof. First we establish a simple claim concerning the restrictions of H. 

Claim 1 Suppose G x C G 2; G x G' and G 2 G". JTien G' C G". 

Proof. Let G' := (S[, . . ., S' n , Pl , . . ., Pn ) and G" := (S'{, . . ., S» Pl , . . .,p n ). 

Suppose s- G iSj. Then for some fa G Bi li Gi we have Vs* G TiPi(s*,fa) < pi(s'^fa). By- 
property A ^ G Bj h G 2 , so s- G S'(. □ 

(i) By definition appropriate transfinite sequences (Gj,) Q < 7 and (G„) a < 7 such that G = G' = Gg, 
G' = G' and G" = G" exist. We proceed by transfinite induction. 

Suppose the claim holds for all (3 < 7. 

Gase -Z. 7 is a successor ordinal, say 7 = /? + 1. 

By the induction hypothesis G'^QG'^. By Claim 1 G 7 C G 2 , where G" p s G 2 . But by the 
definition of the reduction also G 2 C G" So G 7 C G". 

Case £ 7 is a limit ordinal. 

By the induction hypothesis for all j3 < 7 we have G^ C G^. By definition G 7 = H/3<7 G'a anc ^ 
^7 = n/3< 7 Gpi so C 7 C G 7 . 

(ii) Let (G a ) tt <(3 and (G^)q,< 7 be the sequences of the reduction of H that respectively ensure 
H f ^ G and H ^ G. 

Suppose now that on the contrary 7 < /?. Then Gp C G 7 by the definition of the f ~» reduction. 
By (i) we also have G 7 C G' . Further, G 7 = Gp since by assumption both of them equal G, so 
G/3 = G 7 , which is a contradiction. □ 

It is important to note that the outcome of the considered iterated elimination process can be 
an empty game. 

Example 4.4 Consider a two-players game H in which the set of strategies for each player is the 
set of natural numbers. The payoff to each player is the number (strategy) he selected. Suppose 
that beliefs are the strategies of the opponent. Clearly no strategy is a best response to a strategy 
of the opponent. So H 2 . □ 

In general, infinite sequences of the ~> reductions are possible. Even more, in some games to 
steps of the ' reduction are insufficient to reach a B-closed game. 

Example 4.5 Consider the following game H with three players. The set of strategies for each 
player is the set of natural numbers TV. The payoff functions are defined as follows: 



P x(k,£,m) :-- 



p 2 (k,£,m) :- 



k ifk = £ + l 

otherwise 

k \ik = £ 
otherwise 



p 3 (k,£,m) := 0. 

Further we assume the pure belief structure. Each restriction of H can be identified with the 
triple of the strategy sets of the players. Note that 



• the best response to s_i = (I, m) is t + 1, 

• the best response to s_2 = (k, m) is k, 

• each m G TV is a best response to s_3 = (k,£). 

So the following sequence of reductions holds: 

(J\f, J\f, Af) - f -> (AT\{0},Af,Af) f ^ (AA\{0},AA\{0},AA) ^ 

(AA \ {0, 1}, AA \ {0}, Af) ^ (A/" \ {0, l},Af\ {0, 1}, AO ^ ••• 

So (A/", A/", A/") ^ (0,0, A/"). Also (0,0, Af) (0,0,0), so (A/", A/", A/") s ^ u+1 (0,0,0). 

Further, it is easy to see that it is the only maximal sequence of the ~» reductions. □ 

Let us mention here that Lipman [1994] constructed a two-player game for which u steps of 
the ^ ~> reduction are not sufficient to reach a £>-closed game, where each Bi consists of the mixed 
strategies of the opponent. 

These examples bring us to the question: are we studying the right reduction relation? 

5 Variations of the reduction relation 

Indeed, a careful reader may have noticed that we use a slightly different notion of reduction than 
the one considered in Bernheim [1984] and Pearce [1984]. In general, two natural alternatives to 
the ~> relation exist. In this section we introduce these variations and clarify when they coincide. 

Given a restriction G := (Si, . . ., S n ,pi, . . .,p n ) of a game H := (Ti, . . .,T n ,pi, . . .,p n ), a belief 
structure (B, fl) in H, where B := (£>i, . . -,B n ) and a restriction G' := (S[, . . .,S' n ,pi, . . -,p n ) of G, 
the ~> reduction can be alternatively defined by: 

• G ~> G' when G + G' and for all * G [l..n] 

Vsj E Si\ S'i VfJLi £ BiHGBs'i £ Ti Pi(s' i ,fj, i ) > Pi(si,m). 

Two natural alternatives are: 

• G —> G' when G ^ G' and for all i G [l..n] 

Vsj G 5i \ S'I V/ij G ^ h G 3s- G S'i Pi(s'i,Hi) > pi(si,p,i), 

. G^G' when G ^ O and for all i G [l..n] 

Vsj G 5, \ Si Mm £ BiHGBs'i £ S[ p^s'^m) > pi(si,m). 

So in these two alternatives we refer to better responses in, respectively, G and in G' instead of 
in H. 

Clearly G => G' implies G — > Q which implies G ^ G' . However, the reverse implications do 
not need to hold. The following example additionally shows that neither — > nor =>- is order 
independent. Moreover, countable applications of each of these two relations can reduce the initial 
game to an empty game. 



Example 5.1 Reconsider the two-players game H from Example 4.4. Recall that the set of strate- 
gies for each player in H is the set of natural numbers Af and the payoff to each player is the number 
(strategy) he selected. Also, we assume the pure belief structure. 

Given two subsets A\, A2 of the set of natural numbers denote by (A\, A2) the restriction of H 
in which Ai is the set of strategies of player i. Clearly for all k > we have H ~> ({&}, {k}) 02 
and H — > ({k}, {k}) and for no k > and G we have ({k}, {k}) — > G. 

So the relations ~» and — ► differ in the iterations starting at H. Moreover, — ► is not order 
independent. 

Further, for no k > we have H => ({k}, {k}), so the relations — > and => differ, as well. Let 
now for fe > 

(fc, 00) := {£ G M I £ > k}, 
A k :={0}U(fc,oo), 
Bfc := {1} U (k, 00). 

Then both 

H=>(Ai,Ai)=>(A 2 ,A 2 )=> ... 

and 

H^{B 1 ,B 1 )^{B 2 ,B 2 )^ 

so both => w ({0}, {0}) and # => W ({1}, {1}). But for no G and fc > we have ({jfe}, {A;}) =J> G. 
This shows that ^> is not order independent either. 
Finally, note that 

H => ((0, 00), (0, 00)) ^ ((1, 00), (1, 00)) => ... 
so =^^02 and hence H —^02, as well. In fact, we also have H — > 02- □ 

Let us define now the counterpart * — >• of the * ~> reduction by putting for a restriction 
G := (Si, . . ., S n ,pi, . . .,p n ) of H and a restriction G' := (S[, . . ., S' n ,pi, . . -,p n ) of G 

• G f ^G' when G / G' and for all i G [l..n] 

5' = {si e Si I G Si h GVs- G SiPi^Hi) < Pi(si,Hi)}. 

So, unlike in the definition of the relation, we now refer to the best responses in the game 
G. Note that G ^ G' and G -» G" implies G' C G". In Bernheim [1984] and Pearce [1984] the 
' — » reduction was studied, in each paper for a specific belief structure. 

Observe that the corresponding 'fast' reduction * => does not exist. Indeed, in the above example 
we have H =>■ ((A;, 00), (k, 00)) for all k > 0. But f]^ =0 (k, 00) = and H => 02 does not hold. So no 
G' exists such that H G' and for all G" , G ^G" implies G' C G". 

In the game used above we have both H $2 and -ff ^ — ► 02, so both fast reductions coincide 
when started at H. The next example shows that this is not the case in general. Moreover, it 
demonstrates that for the — > relation a stronger reduction can be achieved if non-fast reductions 
are allowed. So the counterpart of Theorem 4.3 does not hold for the — ► relation. 

Example 5.2 Consider a version of Bertrand competition between two firms in which the marginal 
costs are and in which the range of possible prices is the left-open real interval (0, 100]. So in 
this game H there are two players, each with the set (0, 100] of strategies. We assume that the 



demand equals 100 — p, where p is the lower price and that the profits are split in case of a tie. So 
the payoff functions are defined by: 



Pi(si,s 2 ) := < 



P2(s 1 ,s 2 ) := < 

Also, we assume the pure belief structure. Below we identify the restrictions of H with the 
pairs of the strategy sets of the players. 

Since s\ = 50 maximizes the value of si(100 — si) in the interval (0,100], the strategy 50 is 
the unique best response to any strategy s 2 > 50 of the second player. Further, no strategy is a 
best response to a strategy s 2 < 50. By symmetry the same holds for the strategies of the second 
player. So H * ~» ({50}, {50}). Next, s\ = 49 is a better response in H to s 2 = 50 than s\ = 50 
and symmetrically for the second player. So ({50}, {50}) % 2 . 

We also have H f ^> ({50}, {50}). But si = 50 is a best response in ({50}, {50}) to s 2 = 50 
and symmetrically for the second player. So for no restriction G of H we have ({50}, {50}) — > G or 
({50}, {50}) ^ G. However, we also have H -» ((0, 50], (0, 50]) -» 2 . So H can be reduced to the 
empty game using the — > reduction but only if non-fast reductions are allowed. 

Finally, note that also H =^ ((0, 50], (0, 50]) holds. Let (ri)i <u} be a strictly descending sequence 
of real numbers starting with r$ = 50 and converging to 0. It is easy to see that for i > we then 
have ((0,ri],(0,ri])^((0,r- i+ i],(0,r m ]), so H ® 2 . □ 

To analyze the situation when the three considered reduction relations coincide we introduce 
the following property: 

B For all restrictions G of H and all beliefs \ii € Bi n G a best response to \ii in G exists. 

For the finite games property B obviously holds. However, it can fail for infinite games. For 
instance, it does not hold in the game considered in Examples 4.4 and 5.1 since in this game no 
strategy is a best response to a strategy of the opponent. 

In the presence of property B the reductions — > and =>■ are equivalent. 

Lemma 5.3 (Equivalence) Consider a game H and a belief structure (B, fl) in H. Assume 
property B. The relations — > and =>■ coincide on the set of restrictions of H . 

Proof. Clearly if G=>G', then G— >G'. To prove the converse let G := (Si, . . ., S n ,pi, . . -,p n ), 
G' := (Si, . . .,S' n ,p\, . . .,p n ) and B := (B\, . . .,B n ). 

Suppose G — > G' '. Take an arbitrary Sj S Si \ S^ and an arbitrary /ij G Bi fl G. By property 
B some s^ £ 5j is a best response to /Uj in G. By definition this is not eliminated in the step 
G — > G", i.e., s'i € 5j'. So Sj is not a best response to fii in G'. This proves G => G'. □ 

However, the situation changes when we consider the ~> relation. We noted already that G — > G' 
implies G ~> G'. But the converse does not need to hold, even if property B holds. 
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Example 5.4 Suppose that H equals 



and G' is 
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Further, assume the pure belief structure. Property B holds since the game H is finite. 
Since the strategy B is never a best response to a strategy of the opponent in the game H , we 
have G G' but G — > G' does not hold since i? is a best response to L in the game G. □ 

On the other hand, in the presence of properties A and B, iterated applications of the ~» 
reduction started in H do yield the same outcome as the iterated applications of — ► or of =>- . 
Indeed, the following holds. 

Lemma 5.5 (Equivalence) Consider a game H and a belief structure (B, fl) in H. Assume 
properties A and B. For all restrictions G of H , H ~~>~ f G iff H — > 7 G. 

Proof. Since G' -> G" implies G' ~> G" , for all 7 H ^ 7 G implies if ^ G. 

To prove the converse we proceed by transfinite induction. Assume that H -^ 7 G. By definition 
an appropriate transfinite sequence of restrictions (G a ) Q <7 of H with if = Go and G 7 = G exists 
ensuring that H ^ 7 G. 

Suppose the claim of the lemma holds for all < 7. 

Case 1. 7 is a successor ordinal, say 7 = + 1. 

Then if Gyj and Gyj ~> G. Suppose that £> := (B\, . . .,B n ), H := (T±, . . .,T n ,pi, . . .,p n ), 
Gp := (Si, . . -,S n ,pi, . . .,p n ) and G := (S[, . . .,S' n ,pi, . . .,p n ). 

Consider an arbitrary Sj G 5j \ <S^ and an arbitrary /ij £ Bj h such that Sj is not a best 
response in if to /ij. By property A 

/ii G Bi h G Q for all a < 0. (1) 

By property B a best response to \ii in if exists. Then Pi(s^,/Xf) > Pi(si,p,i) and pi(s[, fii) > 
Pi(s",m) for all G Tj. By the latter inequality and (1) s- is not removed in any ~> step leading 
from H to Gp. So G S*j and by the former (strict) inequality Si is not a best response to (ii in 
Gp. This proves G/3 — > G. But by the induction hypothesis H — > @Gp, so H — > 7 G. 

Gase 2. 7 is a limit ordinal. 

By the induction hypothesis for all < 7 we have H G^ iff ii — >^Gp, so by definition 
H^GiSH ^ 7 G. □ 

This allows us to establish an order independence result for the — > and relations. 



Theorem 5.6 (Order Independence) Consider a game H and a belief structure (B, h) in H. 
Assume properties A and B. 

(i) All maximal sequences of the — > , and ^ reductions yield the same outcome G. 

(ii) This restriction G satisfies the following property: 

each strategy Si of player i in G is a best response in G ( note this reference to G and not H ) 
to a belief in Bi n G. 

Proof. 

(i) By the Order Independence Theorem 4.2 and 

(ii) By (i) for no G' we have G — > G' , which proves the claim. □ 

6 Beliefs as joint pure strategies of the opponents 

So far we established results for arbitrary belief structures that satisfy properties A and B. In 
this section we analyze what additional properties hold for the case of pure belief structures. So 
given a game H := (T±, . . .,T n ,pi, . . .,p n ) we assume Bi := TL, for i € [l..n] and for a restriction 
G := (Si, . . .,S n ,pi, . . .,p n ) of H we assume Tlj h G := S-i. 

Clearly, property A then holds. By the Order Independence Theorem 4.2, the outcome of each 
maximal sequence of the ~» reductions is unique. We noted already that this outcome can be an 
empty game. On the other hand, if the initial game has a Nash equilibrium, then this unique 
outcome cannot be a degenerate restriction. Indeed, the following result holds. 

Theorem 6.1 Consider a game H := (T\, . . .,T n ,p\, . . .,p n )- Suppose that H ^> 7 G for some 7. 

(i) If s is a Nash equilibrium of H, then it is a Nash equilibrium of G. Consequently, if G is 
empty, then H has no Nash equilibrium. 

(ii) Suppose that for each s_j G T_j a best response to s_j in H exists. If s is a Nash equilibrium 
of G, then it is a Nash equilibrium of H . 

Proof. 

(i) Let Q be the unique outcome of a maximal sequence of the ~> reductions that starts with 
H -^- 7 G. By definition (si, . . ., s n ) is a Nash equilibrium of H iff each Sj is a best response to s-i 
iff (by the choice of B) ({si}, • • •, {s n }) is £>-closed. Hence, by the Order Independence Theorem 
4.2, each Nash equilibrium s of H is present in G' and hence in G. But G is a restriction of H, so 
s is also a Nash equilibrium of G. 

(ii) Suppose s is not a Nash equilibrium of H. Then some Sj is not a best response to s_j in H. 
By assumption a best response s- to s-i in H exists. Then 

Piis'i.S-i) > pi(s). 



The strategy s- is not eliminated in any ~» step leading from H to G, since s_.; is a joint strategy 
of the opponents of player i in all games in the considered maximal sequence. So s[ is a strategy 
of player i in G, which contradicts the fact that s is a Nash equilibrium of G. □ 



The above result applies to all three reduction relations since H — > 7 Cr implies H ^ 7 G and 
H =4» 7 G implies H ^ G. 

The assumption used in (ii) is implied by property B. A natural situation when property B 
holds is the following. We call a game H := (Ti, . . .,T n ,pi, . . .,p n ) compact if the strategy sets are 
non-empty compact subsets of a complete metric space and own-uppersemicontinuous if each 
payoff function is uppersemicontinuous in the ith argument. 2 

As explained in Dufwenberg and Stegeman [2002] (see the proof of Lemma on page 2012) for 
such games property B holds by virtue of a standard result from topology. Consequently, by 
the Order Independence Theorem 5.6, the order independence for the — » , and ~> reduction 
relations holds. Let us also mention that for this class of games Dufwenberg and Stegeman [2002] 
established order independence of the iterated elimination of strictly dominated strategies. 

If we impose a stronger condition on the payoff functions, namely that each of them is continu- 
ous, then we are within the framework considered in Bernheim [1984]. As shown in this paper if at 
each stage the $ — > reduction is applied, the final (unique) outcome is a non-degenerate restriction 
and is reached after at most u steps. This allows us to draw the following corollary to the Order 
Independence Theorems 4.2 and 5.6. 

Corollary 6.2 Consider a compact game H with continuous payoff functions. All maximal se- 
quences of the ~> (or — > or ) reductions starting in H yield the same outcome which is a 
non- degenerate restriction of H . □ 

If at each stage only some strategies that are NBR are removed, transfinite reduction sequences 
of length > lo are possible. In Section 4 we already noted that in some games such transfinite 
sequences are unavoidable. 

Let us mention here that under the same assumptions about the game H Ambroszkiewicz [1994] 
showed the analogue of the Equivalence Lemma 5.5 for the 'fast' counterparts * ~> and * — > of the 
reduction relations ^ and — > , for the limited case of two-person games and beliefs equal to the 
strategies of the opponent. 3 By the abovementioned result of Bernheim [1984] the corresponding 
iterations of these two reduction relations reach the final outcome after at most u> steps. 

Recall now that a simple strengthening of the assumptions of Bernheim [1984] leads to a frame- 
work in which existence of a (pure) Nash equilibrium is ensured. Namely, assume that strategy 
sets are non-empty compact convex subsets of a complete metric space and each payoff function 
is continuous and quasi-concave in the ith argument. 4 By a theorem of Debreu [1952], Fan [1952] 
and Glicksberg [1952] under these assumptions a Nash equilibrium exists. 

Natural examples of games satisfying these assumptions are mixed extensions of finite games, 
i.e., games in which the players' strategies are their mixed strategies in a finite game H and the 
payoff functions are the canonic extensions of the payoffs in H to the joint mixed strategies. 

Let us modify now the definition of the narrowing operation n by putting for a mixed extension 
H := (T 1 ,...,T n ,p 1 ,...,p n ) and its restriction G : = (Si, . . ., S n ,pi, . . .,p n ) 

T_j DG:= 11,,,*". (2) 

2 Recall that pi is uppersemicontinuous in the ith argument if the set {s^ £ Ti \ pi(s' i ,s-i) > r} is closed for 
all r £ 1Z and all s_i £ T_j. 

3 To be precise, in his definition the 'fast' reductions are defined by considering the reduction for each player in 
succession and not in parallel. 

4 Recall that pi is quasi-concave in the ith argument if the set {s'i £ Ti | jji(s;,s_i) > Pi(s)} is convex for all 
s £ T. 



where for a set Mj of mixed strategies of player j Mj denotes its convex hull. Then, as before, 
properties A and B hold. 

This situation corresponds to the setup of Pearce [1984] in which at each stage all mixed 
strategies that are NBR are deleted and n is defined by (2). Pearce [1984] proved that this iterative 
process based on the * — > reduction terminates after finitely many steps and yields a non-degenerate 
restriction. So we get another corollary to the Order Independence Theorem 4.2 and the Equivalence 
Lemmata 5.3 and 5.5. 

Corollary 6.3 Let H := (T\, . . .,T n ,pi, . . .,p n ) be a mixed extension of a finite game. Suppose 
that H is defined by (2). Then all maximal sequence of the ~» (or — > or => ) reductions yield the 
same outcome which is a non- degenerate restriction of H. □ 

The same outcome is obtained when at each stage only some mixed strategies that are NBR 
are deleted. In this case the iteration process can be infinite, possibly continuing beyond u>. 

7 Finite games 

Finally, we consider the case of finite games, i.e., ones in which all strategy sets are finite. Given 
a finite non-empty set A we denote by AA the set of probability distributions over A. 

Consider a finite game H := . . ., T n ,pi, . . -,p n )- In what follows by a belief of player i in 
the game H we mean a probability distribution over the set of joint strategies of his opponents. So 
AT_j is the set of beliefs. The payoff functions pi are modified to the expected payoff functions in 
the standard way by putting for /ij € AT_,: 



We noted already that for the finite games property B obviously holds. For further considera- 
tions we need the following property: 

C For all non-degenerate restrictions G of H, B; n G ^ 0. 

Note 7.1 Consider a finite game H := (T\, . . .,T n ,pi, . . .,p n ) and a belief structure (B, Pi) in H. 
Assume properties A-C. Then a non- degenerate B-closed restriction of H exists. 

Proof. Keep applying the reduction starting with the original game H . Since now only finite 
sequences of reductions exist, this iteration process stops after finitely many steps. By the 
Equivalence Lemma 5.5 its outcome coincides with the repeated application of the — > reduction. 

But by definition, in the presence of properties A-C, if G is a non-degenerate restriction of H 
and G — > G 1 , then G' is non-degenerate, as well. So in this iteration process only non-degenerate 
restrictions are produced. □ 

Three successively larger sets of beliefs are of interest: 

• Bi = T^i for i € [l..n]. 

Then beliefs are joint pure strategies of the opponents. 

• Bi = Uj^iATj for i € [l..n). 

Then beliefs are joint mixed strategies of the opponents. 




• Bi = AT„j for i e [l..n]. 

Then beliefs are probability distributions over the set of joint pure strategies of the opponents. 

These sets of beliefs are increasingly larger in the sense that we can identify T_j with the subset 
of Uj-^iATj consisting of the joint pure strategies and in turn Hj^ATj with the subset of AT_j 
consisting of the so-called uncorrelated beliefs. 

For Bi C AT_j and G := (Si, . . ., S n ,p\, . . -,p n ) we define then 

B l DG:= {fa € Bi | m(s-i) = for s-i e T_; \ S-i}. (3) 
In particular, in view of the above identifications, 

T_j hG = S-i, 
ll,.-,A7) n G = II ; . ,A.S' r 

and 

AT_j hG = AS-i. 

Consider now properties A and C. Property A obviously holds. In turn, property C holds if 
T_i C Bi for all ie[l..n]. 

Summarizing, in view of Note 7.1 we get the following corollary to the Order Independence 
Theorem 4.2 and the Equivalence Lemmata 5.3 and 5.5. 

Corollary 7.2 Consider a finite game H := (T\, . . .,T n ,p\, . . .,p n ) and suppose that T^i C Bi for 
all i S [l..n] and that h is defined by (3). Then all maximal sequences of the ~> (or — > or =^> ) 
reductions yield the same outcome which is a non- degenerate restriction of H . □ 

In particular, each set Bi can be instantiated to any of the three sets of beliefs listed above. 
However, the assumption that T_j C Bi for all i £ [l..n] excludes systems of beliefs B := (B\, . . .,B n ) 
that consist of the joint totally mixed strategy of the opponents. Recall that a mixed strategy is 
called totally mixed if it assigns a positive probability to each pure strategy. Indeed, any element 
s-i G T_j is a sequence of pure strategies of the opponents of player i and each such pure strategy 
Sj is identified with a mixed strategy that puts all weight on Sj (and hence weight zero on other 
pure strategies). So no element of s_j from T_j can be identified with a totally mixed strategy. 

Observe also that if each Bi is the set of joint totally mixed strategy of the opponents, then for 
each proper restriction G of H the sets Bi fl G are all empty. So Bi fl G does not model the set of 
joint totally mixed strategies of the opponents of player i in the game G. 

The systems of beliefs involving totally mixed strategies were studied in several papers, starting 
with Pearce [1984], where a best response to a belief formed by a joint totally mixed strategy of the 
opponents is called a cautious response. A number of modifications of the notion of rationaliz- 
ability rely on a specific use of totally mixed strategies, see, e.g., Herings and Vannetelbosch [2000] 
where the notion of weak perfect rationalizability is studied. 

Corollary 7.2 does not apply to the iterated elimination procedures based on such systems of 
beliefs. This is not surprising, since as shown in Pearce [1984] a strategy is weakly dominated iff 
it is never a cautious response, and weak dominance is order dependent. In turn, the elimination 
procedure discussed in Herings and Vannetelbosch [2000] is shown to be equivalent to the Dekel 
and Fudenberg [1990] elimination procedure which consists of one round of elimination of all weakly 
dominated strategies followed by the iterated elimination all strictly dominated strategies. 



8 Concluding remarks 



We studied in this paper the problem of order independence for rationalizability in strategic games. 
To this end we relaxed the requirement that at each stage all strategies that are never best responses 
are eliminated. This brought us to a study of three natural reduction relations. 

The iterated elimination of NBR is supposed to model reasoning of a rational player, so we 
should reflect on the consequences of the obtained results. First, we noted that in some games the 
transfinite iterations can be unavoidable. This difficulty was already discussed in Lipman [1994] 
who concluded that finite order mutual knowledge may be insufficient as a characterization of 
common knowledge. 

Next, we noted that in the natural situation when beliefs are the joint pure strategies of the 
opponents empty games can be generated using each of the reduction relations — > and =^ . We 
could interpret such a situation as a statement that in the initial game no player has a meaningful 
strategy to play. Note that Theorem 6.1 allows us to conclude that the initial game has then no 
Nash equilibrium. 

Another issue is which of the three reduction relations is the 'right' one. The first one considered, 
is the strongest in the sense that its iterated applications achieve the strongest reduction. It 

is order independent under a very weak assumption A that captures the idea of a 'well-behaving' 

belief structure. 

However, its definition refers to the strategies of the initial game H which at the moment 
of reference may already have been discarded. This point can be illustrated using the Bertrand 
competition game of Example 5.2. We concluded there that ({50}, {50}) ~» 02 because s\ = 49 is 
a better response of the first player in H to S2 = 50 than s\ = 50 and symmetrically for the second 
player. However, the strategy s\ = 49 is already discarded at the moment the game ({50}, {50}) 
is considered, so — one might argue — it should not be used to discard another strategy. If one 
accepts this viewpoint, then one endorses — ► as the right reduction. This reduction relation is 
not order independent under assumption A but is order independent once we add assumption B 
stating that for each belief /U, in a restriction G of the original game a best response to in G 
exists. 

Finally, we can view the => reduction as a 'conservative' variant of — > in which one insists 
that the 'witnesses' used to discard the strategies should not themselves be discarded (in the same 
round). In the case of the iterated elimination of strictly dominated strategies the corresponding 
reduction relation was studied in Gilboa, Kalai and Zemel [1990] and Dufwenberg and Stegeman 
[2002]. 

Note that the difficulty of chosing the right reduction relation does not arise in Bernheim [1984] 
and Pearce [1984] since for the class of the games there studied properties A and B hold and 
consequently the Equivalence Lemmata 5.3 and 5.5 can be applied. 

In the previous two sections we established order independence for all three reduction relations 
— > and for the same classes of games for which order independence of the iterated elimina- 
tion of strictly dominated strategies (SDS) holds. It was already indicated in Pearce [1984] that the 
iterated elimination of NBR yields a stronger reduction than the iterated elimination of SDS. The 
Bertrand competition game of Example 5.2 provides an illuminating example of this phenomenon. 
In this game all three reduction relations — ► and allow us to reduce the initial game to 
an empty one. However, in this game no strategy strictly dominates another one. Indeed, for any 
s\ and Si such that < s\ < Sj < 100 we have pi(s\,S2) = Pi(s' 1 ,S2) = for all S2 such that 
< S2 < s\ and analogously for the second player. So no strategy can be eliminated on the account 
of strict dominance. 



This advantage of each variant of the iterated elimination of NBR over the iterated elimination 
of SDS disappears if we provide each player with the strategy 0. Then each strategy is a best 
response to the strategy of the opponent, since all of them yield the same payoff, 0. So no 
strategy can be eliminated and all four elimination methods yield no reduction, while the resulting 
game has a unique Nash equilibrium, namely (0,0). 

Let us conclude with an example when two variants of the iterated elimination of NBR allow one 
to identify the unique Nash equilibrium, while the iterated elimination of SDS yields no reduction. 

Example 8.1 Consider Hotelling location game in which two sellers choose a location in the open 
real interval (0, 100). So in this game H there are two players, each with the set (0, 100) of strategies. 
The payoff functions (i = 1, 2) are defined by: 



Si H u Si < s 3 _ 

100 - Si + — — if Si > s 3 _ 
50 if Si = S3_ 



First note that no strategy strictly dominates another one. Indeed, for any s\ and s'i such 
that < s\ < s[ < 100 we have pi(si,S2) < Pi(s[,S2) for all S2 such that s[ < S2 < 100 and 
Pi{si,S2) > pi(s'i,S2) = for all S2 such that < S2 < s\. A symmetric reasoning holds for the 
second player. 

Next, we consider the reduction relations — > and => defined as in Section 6. Note that 
no strategy s\ £ (0,100) \ {50} is a best response in if to a strategy S2 € (0,100). Indeed, if 
si 7^ S2, then we have pi(si, S2) < Pi(s'i, S2) for all s[ such that s[ € (mtn(si, S2), max(si, 82)- And 
if s\ = S2, then by assumption si ^ 50 and we have then pi(s±, 82) = 50 < pi(50, S2). A symmetric 
reasoning holds for the second player. 

So both H ^ ({50}, {50}) and H ^({50}, {50}) and ({50}, {50}) is Nash equilibrium of H. 
Also note that yields no reduction here. □ 
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